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DETAILED ACTION 

1 . This Office Action is response to applicant's Amendment, filed 06/30/2008, in 
which the applicant amends claims 1, 21 and 41-47, and provides arguments for 
patentability in view of 35 USC §112, and over the previously cited prior art. 

Continued Examination Under 37 CFR 1.114 

2. A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
06/30/2008 has been entered. 

Response to Amendment 

3. The applicant's amendments to claims 1, 21, and 41-47 have been considered. 
No new matter has been found. Appropriate objections and rejections are included 
below in the relevant sections of this Office Action 

Response to Arguments 

4. Applicant's arguments filed 06/30/20088 have been fully considered but they are 
not persuasive. 
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The applicant first argues against the rejection of claim 49 under 35 USC §112, 
First Paragraph- specifically the examiner's assertion in previous Office Actions that the 
terms "label amplitude" and "label duration" are not properly disclosed 
within the written description in order to enable one of ordinary skill in the art to make 
use of the invention as claimed- are comprised by "Applicants direct the Examiner to their 
Specification, page 15, lines 23-29, which explicitly discloses 'certain pre-determined criteria 
such as label amplitude or label duration'" (Remarks of 06/30/2008, page 16, paragraph 2). 

While the examiner notes that the applicant has correctly directed attention to the 
Specification's disclosure of the terms "label amplitude" and "label duration", mere 
mention of terms presented in the claims do not necessarily fulfill the requirements of 35 
USC §112, First Paragraph to reasonably convey to one skilled in the relevant art the 
implementation of the invention. While the examiner admits that the applicant has 
included the usage of "label amplitude" and "label duration" in the Specification, such 
terms are not well-known in the art such that one of ordinary skill in the art would 
recognize them as having a generally accepted meaning. Furthermore, the examiner 
maintains that that it would be unclear to one of ordinary skill in the art how to relate 
parameters such as "amplitude" or "duration" to text data such as the labels disclosed in 
the instant application. Though there is a disclosure of the terms within the 
specification, the examiner maintains the assertion that there is no description of either 
a "label amplitude parameter" or "label duration parameter" which resolves the above- 
noted lack of clarity in the usage of the terms. 
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For at least the above reasons, the applicant's arguments regarding the 
patentability of claim 49 in view of 35 USC §112, First Paragraph are not persuasive. 

The applicant next argues against the rejection of claims 1-2, 4, 8, 10, 15-17, 21- 
22, 24, 28, 30 35-37, 41-47 and 50 under 35 USC §1 02(e) as being anticipated by 
Newman (US PGPUB 2003/0101 156, cited in a previous Office Action). The applicant's 
first argument is with respect to the claim amendments, including the limitation of said 
labels being created for locating said respective subject matter 
locations. 

Specifically, the applicant submits that "amended independent claim 1 is now 
amended to recite 'said audio/video data including a narration concurrently provided by a 
narrator specifically to identify where respective subject matter locations arc positioned in 
storage of said audio/video data,' and then using speech recognition for converting the narration 
into labels, 'said labels being text conversions of utterances in said narration, said labels being 
created for locating said respective subject matter locations '." Furthermore, the applicant 
argues that "Newman nowhere discloses creating text labels from a user narration specifically 
for 'locating said respective subject matter locations ' of corresponding video recording as 
claimed by applicants. On the contrary, Newman's audio recording is merely a description of an 
oil-drilling operation (Remarks of 06/30/2008, Page 17, paragraphs 2-3)." 

It is noted by the examiner that a lack of identical intended use between 
inventions does not preclude them being analogous art, as is noted in the previous 
Office Action. It is therefore irrelevant to argue the intended usage of an invention 
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recited in the claims as being a limitation, as this would restrict the broadest reasonable 
interpretation of one of ordinary skill in the art at the time the invention was made. For 
this reason, limitations directly specifically to intended use do not bear patentable 
weight. 

It is further noted by the examiner that removal of the intended usage from this 
limitation will not change the scope of the subject matter beyond the disclosure of 
Newman as applied in the previous Office Action. A full explanation for the applicability 
of the disclosure of Newman to the newly amended claims is included below in the 
appropriate sections of this Office Action. 

The applicant further argues that "The audio recording of Newman is nowhere used 
for performing any sort of label search operation. Applicants therefore submit that Newman fails 
to teach "a label search mode for utilizing said labels to locate said respective subject matter 
locations in said audio/video data." The applicant further notes that [pjaragraph 0017 of 
Newman briefly mentions that text files may be used for "reporting" or may be "displayed" and 
also that [n]o mention is made of any type of label search procedure (Remarks of 06/30/2008, 
Page 17, paragraph 3 - Page 18, paragraph 2). 

The applicant is reminded that the standard of anticipation in the prior art does 
not require an explicit disclosure of each limitation, but may also imply or inherently 
require one or more limitations such that it would enable one of ordinary skill in the art to 
make use of the invention according to the limitations of the claims. 

It is noted by the examiner, as in the previous Office Action, that the disclosure of 
Newman includes a "selective retrieval" and/ or "selective display" of audio, photo 
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and/or video information (Page 2, paragraph 0022- Page 3, paragraph 0023). Selection 
of data from a larger set of data inherently requires some method of searching for the 
purpose of discrimination between the selected data and the larger set of data. 
Therefore, the disclosure of Newman inherently requires a searching procedure in 
disclosing a selective retrieval and display. 

Furthermore, Newman further teaches the use of labels [tags] in providing 
identification of audio, photo and/or video information (Page 3, paragraph 0033), 
including such tags as time/date of data generation. Such tags are well-known in the art 
of media organization as being useful for the purpose of search and selective retrieval. 
It is further noted that Newman explicitly discloses the usage of such tags for the 
purposes of accessing and display and/or playback of media data (Page 1 , paragraph 
0002). Therefore, the examiner maintains that Newman implies the usage of labels 
[tags] for the purposes of searching during selective retrieval and/or selective display, 
as noted in the previous Office Action. 

Lastly, the applicant reminds the examiner that a rejection under 35 U.S.C. §102 
requires that every claimed limitation be identically taught by a cited reference. The applicant 
is reminded that "identical" teachings do not require identical use of language, nor 
explicit disclosure of inherent or implied subject matter in order to meet the standard of 
anticipation as defined by 35 USC §102. 

Therefore, for at least the above reasons, the applicant's arguments regarding 
the patentability of claim 1 over Newman under 35 USC §1 02(e) are not persuasive. 
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It is noted by the examiner that the applicant relies on analogous arguments with 
respect to claims 2, 4, 8, 10, 15-17, 21-22, 24, 28, 30, 35-37, 41-47 and 50. The 

examiner further notes that no further arguments or reasoning are presented in the 
Remarks of 06/30/2008 to show patentability of any of the above claims as patentable 
over Newman. Therefore, the arguments as directed to these claims are not persuasive 
for the same reasons. 

The applicant then argues that the previous rejection of claims 5-6, 9, and 51 
under 35 USC§103. 

The initial argument of the applicant as directed to these rejections cites MPEP 
§2142, in particular emphasizing within the quotation that "the prior art reference (or 
references when combined) must teach or suggest all the limitations ." The applicant does not 
make explicit which of the limitations of the claims is in particular lacking in the showing 
of a prima facie case of obviousness in the previous Office Action. 

However, it is suspected by the examiner that the applicant is referring, at least in 
part, to the limitations added in the newly amended claims regarding the limitation of 
said labels being created for locating said respective subject 
matter locations . The applicant is again reminded that necessitating the intended 
usage of an invention in the claims would restrict the broadest reasonable interpretation 
of one of ordinary skill in the art at the time the invention was made, and therefore 
limitations directed solely to intended use of an invention do not bear patentable weight. 
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A full explanation for the applicability of the disclosure of Newman to the newly 
amended claims is included below in the appropriate sections of this Office Action. 

The applicant then further notes that [i]n the rejections of claims 5-6, 9, and 51, the 
Examiner repated[ly] states that Newman "further renders obvious" various claimed limitations 
without providing any specific references for support. It appears that the Examiner is utilizing 
Official Notice without expressly stating so. This assertion is incorrect in that the previous 
rejections were not based upon a standard of Official Notice, but rather a standard of 
obvious based upon the disclosure of Newman alone, which would suggest such 
features to one of ordinary skill in the art, as indicated in the exposition of analysis of the 
rejections in the previous Office Action. The examiner notes that the applicant makes 
no specific mention directed to which of the limitations of claims 5-6, 9, and 51 are 
addressed using Official Notice, and further provides no specific arguments or 
reasoning to illustrate the differences of the limitations as claimed, and what is rendered 
obvious by the disclosure of Newman as detailed in the previous Office Action. The 
applicant is further reminded that the standard of obviousness does not require an 
explicit disclosure of all the limitations of the claim, but rather a combination of the 
teachings of the references and what would have been known to one of ordinary skill in 
the art at the time the invention was made. For at least these reasons, the arguments 
directed to the rejections of claims 5-6, 9, and 51 are not persuasive. A full analysis of 
the rejections under the standards of obviousness using the teachings of Newman is 
included below in the relevant sections of this Office Action. 
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The applicant next submits arguments that the rejections of claims 3, 14, 18-20, 
23, 34, and 38-40 under 35 USC §103 as being unpatentable over Newman in view of 
Belrose (US PGPUB 2003/0144843, cited in a previous Office Action). It appears that 
the applicant is relying upon the dependency of these claims on independent claims 
which the applicant has asserted to be patentable over the prior art. The applicant 
makes no specific arguments regarding the limitations of claims 3, 14, 18-20, 23, 34, 
and 38-40 independent of the previous arguments regarding one or more parent claims. 
Therefore, the arguments with regards to these claims is considered identical to the 
arguments directed to the parent claims as specified, and are not persuasive for the 
same reasons. 

The applicant next argues that the rejection of claims 7, 12-13, 27, and 32-33 
under 35 USC §103 are patentable over Newman in view of Nicholson (US PGPUB 
2002/0067859, cited in a previous Office Action). 

Firstly, it appears that the applicant is relying upon the dependency of these 
claims on independent claims which the applicant has asserted to be patentable over 
the prior art. The applicant makes no specific arguments regarding the limitations of 
claims 7, 12-13, and 32-33 independent of the previous arguments regarding one or 
more parent claims. Therefore, the arguments with regards to these claims is 
considered identical to the arguments directed to the parent claims as specified, and are 
not persuasive for the same reasons. 
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Secondly, the applicant further argues that Nicholson is not directed toward any field 
of endeavor that remotely resembles that of Applicants' invention... Nicholson does not pertain to 
any sort of digital videography techniques. . . [applicants therefore submit that Nicholson is non- 
analogous art, and is therefore not relevant with respect to Applicants' claimed invention 
(Remarks of 06/28/2008, Page 23, paragraph 1 ). The examiner contends that the 
invention as claimed is not directed principally to videography, but instead to techniques 
for organizing, handling, and storing media data using labels. Nicholson is directed to a 
system of organizing and processing image media using labels. The applicant is 
reminded that video data is in essence a sequence of single photographic images, not 
unlike the media handled in the system taught by Nicholson. In this regard, the 
examiner contends that the teachings of Nicholson are in fact directed to a similar field 
of invention, said field of invention being organization, handling, and storage of media 
data. 

Thirdly, the applicant argues that Nicholson nowhere teaches utilizing the converted 
labels for locating corresponding recorded video information. The applicant is reminded that 
in the previous rejection of claims 7, 12-13, 27, and 32-33 that Nicholson was not relied 
upon for this limitation of said claims, and that this limitation was found in the teachings 
of Newman, as applied above. Therefore, this argument is immaterial to the rejection of 
said claims in the previous Office Action. 

For at least the above reasons, the arguments directed to the patentability of 
claims 7, 12-13, 27, and 32-33 are not persuasive. 
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Lastly, the applicant makes arguments against the previous rejection of claims 
11,31 and 48 under 35 USC §1 03 as being unpatentable over Newman in view of 
Adams (US PGPUB 2004/0008209, cited in a previous Office Action). 

Applicant makes note of the teachings of Adams for a "multi-media photo album" 
that allows a user to manually select stored audio data corresponding to a given photograph 
(Remarks of 06/30/2008, Page 23, paragraph 4). The applicant appears to have 
disregarded the disclosure of Adams directed to automatic generation of labels [meta- 
data] (Page 3, paragraphs 0074-0080), as cited in the rejections of the previous Office 
Action. Though Adams does teach a manual operation of a multi-media photo album, 
such teachings in no way invalidate the disclosure of automatic operation of the same. 

It further appears that the applicant is relying upon the dependency of these 
claims on independent claims which the applicant has asserted to be patentable over 
the prior art. The applicant makes no specific arguments regarding the limitations of 
claims 11, 31 and 48 independent of the previous arguments regarding one or more 
parent claims. Therefore, the further arguments with regards to these claims is 
considered identical to the arguments directed to the parent claims as specified, and are 
not persuasive for the same reasons. 

For at least the above reasons, the applicant's arguments pertaining to the 
patentability of claims 1 1 , 31 , and 48 are not persuasive. 



Claim Objections 

5. Claims 1,21, and 41 -47 are objected to because of the following informalities: 
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• claims 1 and 44-47 each include a limitation of said labels being 
created for locating said respective subject matter 
locations; 

• claims 21 and 41-43 each include a limitations of said text labels 
being crated for locating said respective subject matter 
locations; 

It is improper to include a limitation of the claims that relies upon the intended 
use as claimed, as doing so conflicts with the broadest reasonable interpretations of 
one of ordinary skill in the art. If the prior art is capable of performing the intended use, 
then it meets the claim. Therefore, intended use limitations must result in an 
operational or structural difference in the invention to carry patentable weight. 

The examiner suggests amending these claims to remove intended use 
language e.g., "said labels being useful for locating said respective subject matter 
locations." Note that an amendment of this type does not indicate allowability of the 
contents of the claims over the prior art. 

Appropriate correction is required. 

Claim Rejections - 35 USC §112 

6. The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 
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7. Claim 49 is rejected under 35 U.S.C. 112, first paragraph, as failing to comply 
with the written description requirement. The claim(s) contains subject matter which 
was not described in the specification in such a way as to reasonably convey to one 
skilled in the relevant art that the inventor(s), at the time the application was filed, had 
possession of the claimed invention. 

Specifically, claim 49 contains reference to both a label amplitude 
parameter and a label duration parameter. It is noted by the examiner that 
the labels are established as text data according a limitation of parent claim 1. No 
description of either a "label amplitude parameter" or "label duration parameter" was 
found by the examiner in the specification of the present application. The examiner 
further contends that it would be unclear to one of ordinary skill in the art how to relate 
parameters such as "amplitude" or "duration" to text data such as the labels disclosed in 
the instant application, though both parameters are well known in the art in relation to 
speech data. 

For these reasons, the examiner contends that the limitations of claim 49 in the 
instant application are not in compliance with the written description requirement of 35 
USC §1 1 2, first paragraph. 

Claim 49 is rejected under 35 U.S.C. 112, first paragraph, as failing to comply 
with the enablement requirement. The claim(s) contains subject matter which was not 
described in the specification in such a way as to enable one skilled in the art to which it 
pertains, or with which it is most nearly connected, to make and/or use the invention. 
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Specifically, claim 49 contains reference to both a label amplitude 
parameter and a label duration parameter. It is noted by the examiner that 
the labels are established as text data according a limitation of parent claim 1. No 
description of either a "label amplitude parameter" or "label duration parameter" was 
found by the examiner in the specification of the present application that would enable 
one of ordinary skill in the art to make use of the invention as presented in the 
limitations of claim 49. The examiner further notes that neither "label amplitude 
parameter" nor "label duration parameter" are terms that are well-known in the art, and 
therefore would require a proper description and/or definition to ensure that the 
specification teaches all limitations of claim 49. The examiner further contends that it 
would be unclear to one of ordinary skill in the art how to relate parameters such as 
"amplitude" or "duration" to text data such as the labels disclosed in the instant 
application, though both parameters are well known in the art in relation to speech data. 

For these reasons, the examiner contends that the limitations of claim 49 in the 
instant application are not in compliance with the written description requirement of 35 
USC §112, first paragraph because they do not enable one of ordinary skill in the art to 
make use of the invention as claimed. 

Claim Rejections - 35 USC § 102 

8. The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 
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9. Claims 1-2, 4, 8, 10, 15-17, 21-22, 24, 28, 30, 35-37, 41-47 and 50 are rejected 
under 35 U.S.C. 102(e) as being anticipated by US Patent Application Publication 
2003/0101 156, hereinafter referred to as Newman. 

Regarding claim 1, Newman discloses a system for cataloguing information 
comprising: 

• an electronic device that captures audio/video data 
corresponding to a photographic target [data acquisition device] 
(Col. 2, paragraphs 0012-0014; Col. 3, paragraph 0032), 

• said audio/video data [Audio, photo and/or video; APV data] including 
a narration [audio messages] concurrently provided by a 
narrator specifically to identify where respective subject 
matter locations are positioned in said audio/video data 
[selectively retrieved] (Col. 2, paragraphs 0019, 0022-0023, 0025; Col. 3, 
paragraphs 0032-0033); 

• a speech recognition engine that automatically performs a 
speech recognition process upon said narration to generate 
labels [tags] that correspond to said respective subject 
matter locations in said audio/video data (Page 2, paragraph 
0017; Page 3, paragraphs 0025, 0033), 

• said labels being text conversions of utterances in said 
narration (Page 3, paragraph 033 - Page 4, paragraph 0036); and 
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• a label manager [accessing apparatus] that manages a label mode 
for generating and storing said labels (Page 3, paragraph 0033; 
Page 4, paragraphs 0035, 0038; Claim 1), 

• said label manager also controlling a label search mode for 
utilizing said labels to locate said respective subject 
matter locations in said audio/video data [selectively retrieved] 
(Page 2, paragraph 0022 - Page 3, paragraph 0023; Page 3, paragraph 0033; 
Page 4, paragraphs 0038-0039). 

Though Newman does not explicitly disclose that tag information is used to help 
locate data in a storage device, this is implied in disclosing the use of tags to provide 
identification such as user information and/or date and time of file creation (Page 3, 
paragraph 0033) because such information is well known in the art for use in selectively 
finding data in a database, and Newman explicitly teaches the selectively searching for 
data in the database (Page 3, paragraph 0023). 

Selection of data from a larger set of data inherently requires some method of 
searching for the purpose of discrimination between the selected data and the larger set 
of data. Therefore, the disclosure of Newman inherently requires a searching 
procedure in disclosing a selective retrieval and display. 

Furthermore, Newman further teaches the use of labels [tags] in providing 
identification of audio, photo and/or video information (Page 3, paragraph 0033), 
including such tags as time/date of data generation. Such tags are well-known in the art 
of media organization as being useful for the purpose of search and selective retrieval. 
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It is further noted that Newman explicitly discloses the usage of such tags for the 
purposes of accessing and display and/or playback of media data (Page 1 , paragraph 
0002). Therefore, the examiner contends that Newman implies the usage of labels 
[tags] for the purposes of searching during selective retrieval and/or selective display. 

It is noted by the examiner that though Newman does not explicitly disclose that said 
labels are specifically created for locating said respective subject 
matter locations, this is inherent in the teachings of Newman to use identification 
such as user information and/or date and time of file creation (Page 3, paragraph 0033), 
because such information is always capable of providing a method of locating subject 
matter [data], such as in the selective retrieval disclosed by Newman (Page 3, 
paragraph 0023). 

Regarding claim 2, Newman discloses all limitations of claim 1 as applied 
above, and further discloses that said electronic device is implemented as 
an audio/video camcorder device [video camera] (Page 2, paragraphs 0014, 
0021; Page 3, paragraph 0032). 

Regarding claim 4, Newman discloses all limitations of claim 1 as applied 
above, and further discloses that said label manager initially instructs 
said electronic device to enter a real-time label mode [data 
acquisition devices read at a fixed time interval] for creating and storing said 
labels [tags] (Page 3, paragraphs 0032-0033), said electronic device 
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concurrently [run continuously or run selectively at desired times] capturing 
said audio/video data and said narration after said label 
manager instructs said electronic device to enter said real-time 
label mode (Page 3, paragraph 0032). 

Regarding claim 8, Newman discloses all limitations of claim 1 as applied 
above, and further discloses that said label manager stores said labels 
during a real-time label mode, said labels being stored along 
with meta-inf ormation that associates each of said respective 
subject matter locations to a corresponding one of said labels 
[date and time] (Page 3, paragraph 0033). 

Regarding claim 10, Newman discloses all limitations of claim 1 as applied 
above, and further discloses that said label manager instructs said 
electronic device to enter a non-real-time label mode [data access 
after operation is complete] for creating and storing said labels [data 
review], said electronic device responsively retrieving and 
playing back said audio/video data and said narration (Page 4, 
paragraph 0035-0037) . 

Regarding claim 15, Newman discloses all limitations of claim 1 as applied 
above, and further discloses that said label manager stores said labels in 
a non-real-time label mode, said labels being stored along with 
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meta-inf ormation that associates each of said respective subject 
matter locations to a corresponding one of said labels [tags] (Page 
3, paragraph 0032-0033; Page 4, paragraph 0035-0037). 

Regarding claim 16, Newman discloses all limitations of claim 1 as applied 
above, and further discloses that said label manager instructs said 
electronic device to enter said label search mode during which a 
system user interactively selects a search label for performing 
a label search procedure to locate a specific one of said 
respective subject matter locations corresponding to said search 
label [selectively retrieved] (Page 2, paragraphs 0022-0023; Page 3, paragraph 0032; 
Page 4, paragraph 0038). 

Though Newman does not explicitly disclose that tag information is used to help 
locate data in a storage device, this is implied in disclosing the use of tags to provide 
identification such as user information and/or date and time of file creation (Page 3, 
paragraph 0033) because such information is well known in the art for use in selectively 
finding data in a database, and Newman explicitly teaches the selectively searching for 
data in the database (Page 3, paragraph 0023). 

Regarding claim 17, Newman discloses all limitations of claim 1 as applied 
above, and further implies that said label manager generates a label- 
search GUI on a display of said electronic device, a system user 
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viewing said labels and corresponding representative images [icons] 
from said audio/video data for selecting a search label (Page 4, 
paragraph 0035-0038) in disclosing that the data retrieval system as disclosed by 
Newman includes a selective display capability for presenting relevant data to a user. 

Regarding claims 21-22, 24, 28, 30, and 35-37, these claims are very similar to 
claims 1-2, 4, 8, 10, and 15-17 respectively as applied above, and are rejected for the 
same reasons. 

Regarding claims 41-42 and 44-47, each of these claims is very similar to claim 
1 as applied to above, and is rejected for the same reasons. 

Regarding claim 43, this claim contains limitations very similar to those found in 
a combination of claims 1, 8, 13, and 15, which are all addressed by Newman 
individually, and therefore claim 43 is rejected for the same reasons. 

Regarding claim 50, Newman discloses all limitations of claim 17 as applied 
above, and further disclose that said representative images are 
implemented as thumbnail images [icons corresponding to an image related to 
data] (Page 4, paragraphs 0037, 0039). 
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Claim Rejections - 35 USC § 103 

1 0. The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

1 1 . Claims 5-6, 9 and 51 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Newman. 

Regarding claim 5, Newman discloses all limitations of claim 1 as applied 
above, and further renders obvious that said electronic device enters a 
real-time label mode in response to a verbal label-mode command 
from a system user, said verbal label-mode command being 
recognized and provided to said label manager by said speech 
recognition engine in disclosing a system for labeling [tags] data (Page 3, 
paragraph 0033) that is responsive to selective searching (Page 2, paragraph 0022 - 
Page 3, paragraph 0023), and additionally includes voice recognition components for 
entering data (Page 3, paragraph 0025). 

Because Newman teaches both verbal commands of the system, and also 
teaches labeling data, both elements of the claim are known in view of the teachings of 
Newman. Furthermore, speech control is one of a finite number of input methods for 
the system as taught by Newman and there is reasonable expectation of success for 
one of ordinary skill in the art to adapt the speech control disclosure of Newman to 
accommodate input of label [tag] data. The examiner further contends that any system 
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that operates on the time-dependent basis of voice-input must inherently operate in 
real-time for proper functional operation to the end-user. Therefore, because Newman 
teaches all components of the limitations of claim 5, including a verbal command mode 
as one of a finite number of inputs to the system and an input of label data mode, and 
one of ordinary skill in the art would have no reason not to expect success in adapting 
the verbal commands to include input of label data, it would have been obvious for one 
of ordinary skill in the art at the time the invention was made to modify the teachings of 
Newman to accommodate greater flexibility of data input by doing so. 

Regarding claim 6, Newman discloses all limitations of claim 1 as applied 
above, and further renders Obvious that said speech recognition engine 
automatically generates said labels as said electronic device 
captures said audio/video data and said narration (Page 2, paragraph 
0017; Page 3, paragraph 0032-0033; Page 4, paragraph 0036) by disclosing user 
access in real-time operation (Page 4, paragraph 0036), that said real-time operation 
includes the creation of labels [tags] (Page 3, paragraph 0033), and also that the 
system is implemented in such a way that it is operable by speech recognition methods 
(Page 2, paragraph 0022 - Page 3, paragraph 0023; Page 3, paragraph 0025). 

Because Newman teaches both verbal commands of the system, and also 
teaches labeling data in real-time, all elements of the claim are known in view of the 
teachings of Newman. Furthermore, combining such elements as taught by Newman 
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would yield predictable results, and one of ordinary skill in the art would have no reason 
not to expect success in attempting to do so in view of the teachings of Newman. 

Therefore, the examiner contends that it would have been obvious for one of 
ordinary skill in the art in view of Newman to modify the real-time operation of Newman 
to include creation of labels [tags] in real-time using voice recognition during capture of 
audio/video data in order to accommodate greater flexibility of data input by doing so. 

Regarding claim 9, Newman discloses all limitations of claim 1 as applied 
above, and further renders obvious that said electronic device initially 
captures said audio/video data and said narration prior to 
entering said label mode (Page 3, paragraph 0033; Page 4, paragraph 0036) 
by disclosing label creation [user data access] need not be concurrent with initial 
capturing of audio/video data [APV files] (Page 4, paragraph 0036), and that the data 
may be stored for later user access (Page 4, paragraph 0035). Motivation to allow for 
later labeling [tags] of the data is disclosed by Newman in disclosing the need to allow 
users not present to access and organize audio/video data at a later time (Page 4, 
paragraph 0035-0036). 

Therefore, the examiner contends that it would have been obvious for one of 
ordinary skill in the art to modify the teachings of Newman in order to allow users not 
present for the initial data capture to access and organize data using tag information at 
a later date. 
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Regarding claim 25, this claim is very similar to claim 5 and is rejected for the 
same reasons. 

Regarding claim 26, this claim is very similar to claim 6 and is rejected for the 
same reasons. 

Regarding claim 29, this claim is very similar to claim 9 and is rejected for the 
same reasons. 

Regarding claim 51, Newman discloses all limitations of claim 1 as applied 
above, and further renders obvious that said electronic device is a single 
discrete video camcorder that hosts said speech recognition 
engine, said label manager, said labels, and said audio/video 
data (Page 1, paragraph 0006; Page 2, paragraphs 0014-0015, 0021; Page 3, 
paragraph 0032) in disclosing the inclusion of a camcorder as a device for initial data 
capture [video camera] (Page 2, paragraph 0014; Page 3, paragraph 0033), and that 
the system can be embodied in a single device (Page 1, paragraph 0006). 

Because all limitations of the claim are taught by Newman, they would have been 
known to one of ordinary skill in the art in view of Newman at the time the invention was 
made. Furthermore, motivation to combine the elements taught in Newman would exist 
because it is well-known in the art to integrate functionality of system into a single 
portable device to increase convenience and transportability of said system. Therefore 
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the examiner contends that it would have been obvious to one of ordinary skill in the art 
in view of Newman to combine the elements of Newman in order to implement a single 
device encapsulating all elements of the system disclosed by Newman for the purpose 
of increasing convenience and transportability of said system. 

12. Claims 3, 14, 18-20, 23, 34, and 38-40 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Newman in view of Belrose (US Patent Application 
Publication2003/01 44843), cited in a prior Office Action. 

Regarding claim 3, Newman discloses all limitations of claim 1 as applied 
above. Newman does not disclose, but Belrose discloses: 

• said speech recognition engine is configured in a 
simplified configuration [specific queries] that efficiently 
compares said narration with acoustic models to 
identify phone strings [recognizing a user information request] 
that represent said narration [speech input] (Page 2, 
paragraph 0030; Page 3, paragraphs 0047, 0051-0052), 

• said speech recognition engine referencing a compact 
dictionary to look up recognized vocabulary words that 
correspond to said phone strings [one or more queries] (Page 
3, paragraph 0048), 
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• said speech recognition engine utilizing a limited set 
of recognition grammar to form said recognized 
vocabulary words into said labels [label for a feature] that 
are supported by said speech recognition engine (Page 6, 
paragraph 0106). 

The two references are combinable because each is directed to a system for 
capturing, storing, and browsing audio and/or video data and organizing said data using 
labels for ease of access to said data. Belrose further provides motivation to combine 
the references in disclosing the utility of encapsulating such a system into a mobile 
device [cellular telephone] operable using voice commands (Page 1, paragraph 0003) 
to allow free mobility of the system. 

Therefore, the examiner contends that it would have been obvious to combine 
the teachings of Newman with the teachings of Belrose in order to implement a media 
browser organized using labels that is further encapsulated into a mobile device 
operable using voice commands to allow free mobility of the system. 

Regarding claim 14, Newman discloses all limitations of claim 1 as applied 
above. Newman does not disclose, but Belrose discloses that said label manager 
coordinates a label validation procedure for validating said 
labels in response to verbal validation commands from a system 
user [identification], said verbal validation commands being 
recognized and provided to said label manager by said speech 
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recognition engine [determine the nature of the information to be recorded] (Page 
6, paragraph 0098-0108). 

This limitation is directly related to the voice command input limitation disclosed 
by Belrose as applied above to claim 3. Therefore, the motivation to combine the 
references is the same for claim 14 as applied above for claim 3. 

Regarding claim 18, Newman discloses all limitations of claim 1 as applied 
above. Newman does not disclose, but Belrose discloses that a system user 
selects a search label by issuing a verbal search-label command 
[hotspot label], said verbal search-label command being recognized 
and provided to said label manager by said speech recognition 
engine (Page 6, paragraph 01 06; Page 7, paragraphs 01 1 0-01 1 3) . 

This limitation is directly related to the voice command input limitation disclosed 
by Belrose as applied above to claim 3. Therefore, the motivation to combine the 
references is the same for claim 18 as applied above for claim 3. 

Regarding claim 19, Newman discloses all limitations of claim 1 as applied 
above. Newman does not disclose, but Belrose discloses that said label manager 
instructs said electronic device to automatically locate and 
retrieve a specific one of said respective subject matter 
locations in response to a system user selecting a search label 
[hotspot dialogue blocks] (Page 6, paragraphs 0106-0108). 
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Regarding claim 20, Newman discloses all limitations of claim 1 as applied 
above. Newman does not disclose, but Belrose discloses that said electronic 
device automatically plays back a specific retrieved one of said 
respective subject matter locations [greeting dialog block specific to 

narrator] from said audio/video data for viewing by said system 
user (Page 6, paragraphs 0097-0100). 

Regarding claim 23, this claim is very similar to claim 3 and is rejected for the 
same reasons. 

Regarding claim 34, this claim is very similar to claim 14 and is rejected for the 
same reasons. 

Regarding claims 38-40, these claims are very similar to claims 18-20 

respectively and are rejected for the same reasons. 

1 3. Claims 7, 12-13, 27, and 32-33 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Newman in view of Nicholson (US Patent Publication Application 
2002/0067859), cited in the previous Office Action. 

Regarding claim 7, Newman discloses all limitations of claim 1 as applied 
above. Newman does not disclose, but Nicholson discloses a post processor [digital 
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processor] operating in real-time to perform a validation procedure for the labels based 
upon confidence measures [threshold confidence level] (Page 2, paragraph 0012). 

The two references are combinable because each is directed to a system for 
retrieving media data using labels for the purpose of allowing better organization of said 
data. Nicholson further provides motivation to combine in disclosing the utility of a 
system that is able to discriminate between identifiable and non-identifiable data for the 
purpose of maintaining a high level of recognition by the user of decoded data with a 
minimal additional storage cost (Page 2, paragraph 0014). 

Therefore, the examiner contends that it would have been obvious to one of 
ordinary skill in the art at the time the invention was made to combine the teachings of 
Newman and Nicholson in order to implement a system for retrieving media data using 
labels that utilizes discrimination between identifiable and non-identifiable data in order 
to maintain a high level of user recognition of decoded data with minimal additional 
storage costs. 

Regarding claim 12, this claim is very similar to claim 7 and is rejected for the 
same reasons. 

Regarding claim 13, Newman discloses all limitations of claim 1 and additionally 
discloses a validation graphical user interface [display] allowing users to evaluate, 
delete, and edit labels [tags] (Page 4, paragraphs 0035-0037). 
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Newman does not disclose, but Nicholson discloses coordinating a label 
validation procedure for validating said labels (Page 2, paragraph0012). 

The limitations of claim 13 are very similar to those of claim 7, and therefore the 
motivation to combine the references is the same for claim 13 as for claim 7. 

Regarding claim 27, this claim is very similar to claim 7 and is rejected for the 
same reasons. 

Regarding claims 32-33, these claims are very similar to claims 12-13 

respectively, and each is rejected for the same reasons respectively. 

14. Claims 11,31, and 48 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Newman in view of Adams (US Patent Application Publication 
2004/0008209), cited in a previous Office Action. 

Regarding claim 11, Newman discloses all limitations of claim 1 as applied 
above. Newman does not disclose, but Adams discloses automatically [addressing 
devices automatically] generating labels [meta-data] by analyzing audio/video data and 
narration data during playback of said audio/video data and said narration data (Page 3, 
paragraph 0074-0080). 

The two references are combinable because each is directed to a system for 
storage and retrieval of media data. Adams provides motivation in disclosing the utility 
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of providing automated association of meta-data to audio/video data in order to allow for 
more efficient organization of audio/video data (Page 6, paragraph 01 1 1 ). 

Therefore, the examiner contends that it would have been obvious to one of 
ordinary skill in the art at the time the invention was made to combine the teachings of 
Newman and Adams in order to implement a system for storage and retrieval of media 
data that utilizes automated association of meta-data to said media data in order to 
allow for more efficient organization of said media data. 

Regarding claim 31 , this claim is very similar to claim 1 1 and is rejected for the 
same reasons. 

Regarding claim 48, Newman discloses all limitations of claim 8 as applied 
above. Newman does not disclose, but Adams implies the use of video timecode 
information as a component of said meta-data in disclosing the storage of meta-data 
that comprises arrangement data with regard to media data such as video data (Page 3, 
paragraph 0079), because timecode information is a well-known and readily-available 
method of arranging frames of video data. 

The motivation to combine the references as applied to claim 48 is the same as 
applied above to claim 11, because each claim presents limitations that are applicable 
to the automatic arrangement and organization of data and meta-data on a storage 
component of a media data retrieval system. 
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Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to David Kovacek whose telephone number is (571)270- 
3135. The examiner can normally be reached on M-F 9:00am - 5:30pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David Hudspeth can be reached on (571) 272-7843. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Talivaldis Ivars Smits/ 
Primary Examiner, Art Unit 2626 

DMK, 08/08/2008 



